Add Executor::spawn_io#7894
Conversation
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
bd04da1 to
8bf5b2c
Compare
Polar Signals Profiling ResultsLatest Run
Previous Runs (1)
Powered by Polar Signals Cloud |
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
8bf5b2c to
d59e6ab
Compare
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.156x ❌ datafusion / vortex-file-compressed (1.156x ❌, 0↑ 7↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.005x ➖, 0↑ 1↓)
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
datafusion / parquet (1.018x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.996x ➖, 0↑ 1↓)
duckdb / parquet (1.001x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.010x ➖, 0↑ 0↓)
datafusion / parquet (1.014x ➖, 1↑ 2↓)
datafusion / arrow (1.007x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.013x ➖, 0↑ 0↓)
duckdb / parquet (1.013x ➖, 0↑ 1↓)
duckdb / duckdb (1.013x ➖, 0↑ 1↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMENo file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.031x ➖, 0↑ 8↓)
datafusion / vortex-compact (1.014x ➖, 1↑ 3↓)
datafusion / parquet (1.013x ➖, 1↑ 4↓)
duckdb / vortex-file-compressed (1.015x ➖, 1↑ 3↓)
duckdb / vortex-compact (1.022x ➖, 0↑ 5↓)
duckdb / parquet (1.014x ➖, 0↑ 4↓)
duckdb / duckdb (1.008x ➖, 4↑ 5↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.938x ➖, 1↑ 0↓)
datafusion / vortex-compact (0.941x ➖, 0↑ 0↓)
datafusion / parquet (1.146x ➖, 0↑ 2↓)
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.129x ➖, 0↑ 1↓)
duckdb / parquet (0.990x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.960x ➖, 1↑ 1↓)
datafusion / vortex-compact (0.981x ➖, 0↑ 2↓)
datafusion / parquet (1.034x ➖, 0↑ 3↓)
duckdb / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.989x ➖, 0↑ 0↓)
duckdb / parquet (0.962x ➖, 0↑ 0↓)
Full attributed analysis
|
Merging this PR will not alter performance
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.992x ➖, 1↑ 0↓)
duckdb / vortex-compact (1.017x ➖, 0↑ 0↓)
duckdb / parquet (1.035x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.001x ➖, 0↑ 0↓)
datafusion / parquet (1.006x ➖, 0↑ 0↓)
datafusion / arrow (0.997x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
duckdb / parquet (0.991x ➖, 0↑ 0↓)
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.046x ➖, 1↑ 1↓)
datafusion / parquet (1.047x ➖, 0↑ 3↓)
duckdb / vortex-file-compressed (1.019x ➖, 5↑ 4↓)
duckdb / parquet (1.014x ➖, 0↑ 0↓)
duckdb / duckdb (1.048x ➖, 0↑ 6↓)
Full attributed analysis
|
File Sizes: Clickbench on NVMEFile Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
Benchmarks: Random AccessVortex (geomean): 0.904x ➖ unknown / unknown (0.930x ➖, 12↑ 0↓)
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.050x ➖, 0↑ 1↓)
datafusion / vortex-compact (1.048x ➖, 0↑ 2↓)
datafusion / parquet (1.117x ➖, 0↑ 2↓)
duckdb / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.986x ➖, 0↑ 1↓)
duckdb / parquet (0.984x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: CompressionVortex (geomean): 1.000x ➖ unknown / unknown (0.970x ➖, 11↑ 3↓)
|
9eb6241 to
0b62d9d
Compare
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
0b62d9d to
57121e9
Compare
Summary
Allow
Executorimplementation to split their async IO and CPU work on different runtimes.